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Three  methods  for  smoothing  images  are  presented.  All 
three  use  variable  numbers  of  picture  points  over  which  the 
smoothing  functions  are  defined.  The  first  method  examines 
the  histogram  of  a  neighborhood  of  each  point.  The  subset 
of  gray  values  most  similar  to  that  of  the  point  is  used  in 
calculating  the  smoothing  functions.  The  other  two  methods 
use  quadtree  approximations  to  smooth  the  image.  One  of  these 
uses  the  sizes  of  the  leaves  in  the  quadtree  to  determine 
neighborhood  sizes  over  which  to  apply  a  smoothing  function, 
while  the  other  refines  the  gross  smoothing  defined  by  the 
quadtree.  All  the  methods  perform  fairly  well,  but  the  quad¬ 
tree  methods  are  particularly  attractive  because  of  the  infor¬ 
mation  about  region  sizes  and  homogeneity  provided  by  the 
quadtree  structure . 
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Digital  image*  usually  contain  nois*  of  various  kinds.  Host  image 
procesing  tasks  arc  considerably  simplified  if  this  noise  can  be 
removed.  A  common  approach  to  noise  removal  is  to  "smooth"  the 
image  by  replacing  each  pixel  value  by  a  new  value  which  is  a 
function  of  the  values  in  some  neighborhood  of  the  pixel  C73  . 

The  effect  of  smoothing  is  to  make  the  distribution  of  gray  lev¬ 
els  in  the  image  more  clustered.  This  is  reflected  by  the  spikier 
histogram  of  the  smoothed  image  (e. g.  Figure  S)  and  by  busyness 
measures  which  decrease  when  the  image  is  smoothed.  For  many  pur- 
poses<  preprocessing  an  image  by  smoothing  can  significantly  im¬ 
prove  the  results  of  later  operations  on  the  image.  For  example* 
smoothing  reduces  spurious  edge  responses  to  an  edge  operator, 
while  in  segmentation  schemes  based  on  complementing  edge  infor¬ 
mation  with  region  information  C33*  smoothing  reduces  the  number 
of  false  responses. 

Hany  smoothing  schemes  have  been  proposed  based  on  examining 
fixed  neighborhoods  of  each  pixel.  For  example,  median  filtering 
replaces  each  pixel  value  by  the  median  of  the  values  in  some 
neighborhood  of  the  pixel.  Other  method*  attempt  to  vary  the  size 
of  the  neighborhood  dynamically,  for  example,  by  adding  only 
those  points  whose  gray  levels  are  sufficiently  similar  to  the 
point  being  smoothed.  In  both  these  kinds  of  methods,  the  neigh¬ 
borhood  size  is  usually  kept  small.  In  the  first  case,  small 
neighborhoods  preserve  detail  better  and  are  less  likely  to  cross 
region  boundaries  and  blur  edges.  In  the  second  case,  the  amount 


of  computation  may  become  excessive;  in  addition  such  mathods  ara 
not  applicabla  to  textured  ragions.  It  is  dasirabla  to  ba  abla 
to  usa  larga  neighborhoods  in  homoganaous  ragions  and  small 
naighborhoods  naar  tha  ragion  boundarias.  Furthar  advantagas  can 
ba  gainad  if  tha  cost  of  using  larga  naighborhoods  can  ba  re- 
ducad.  This  papar  dascribas  thraa  mathods  of  imaga  smoothing  that 
axhibit  thasa  dasirad  propartias. 

Tha  first  mathod  axaminas  a  larga  naighborhood  of  a  point  and  as- 
timatas  tha  most  suitabla  gray  laval  mapping  for  tha  point  by 
analyzing  tha  histogram  of  that  ragion.  Tha  othar  two  mathods 
are  based  on  quadtree  approx imations  of  the  imageC53.  A  2nx  2n 
gray  level  image  can  be  represented  in  a  quadtree  by  successively 
subdividing  it  into  four  quadrants  or  blocks. Those  blocks  that 
ara  reasonably  homogeneous  give  rise  to  leaf  nodes  in  tha  tree 
while  those  that  ara  busy  or  through  which  edges  pass  are 
represented  by  branch  nodes  and  are  further  subdivided.  Tha  gray 
laval  of  a  leaf  node  is  tha  average  gray  level  of  tha  correspond¬ 
ing  block  in  the  original  image.  By  traversal  of  tha  quadtree  it 
is  possible  to  reconstruct  an  approximation  to  the  original  image 
by  setting  tha  area  corresponding  to  each  leaf  node  to  tha  gray 
laval  of  that  leaf.  The  size  of  each  leaf  in  tha  tree  depends  on 
tha  busyness  of  tha  corresponding  ragion  of  tha  original  image. 
Relatively  homoganaous  ragions  ara  represented  by  larga  leaves 
while  busy  ones  ara  represented  by  small  leaves. 

Tha  second  smoothing  mathod  uses  tha  quadtree  to  determine  tha 
naighborhood  size  for  smoothing.  If  a  pixel  in  tha  imaga  is  part 


of  a  region  represented  bg  a  large  leaf  it  it  smoothed  using  a 
large  neighborhood!  if  it  is  part  of  a  region  represented  by  a 
small  leaf  it  is  smoothed  using  a  small  neighborhood. 

The  third  smoothing  method  uses  the  image  reconstructed  from  the 
quadtree  and  a  mapping  function.  The  function  maps  points  in  the 
image  to  gray  levels  obtained  from  the  quadtree  approximation! 
and  attempts  to  determine  the  best  mapping  for  each  pixel. 

All  three  methods  are  discussed  below  and  examples  are  given  of 
their  use. 

2-  Smoothing  methods 

2- 1  Local  Mgtgqriffl  peak  sharpening 

For  certain  classes  of  images#  peaks  in  the  image  histogram 
correspond  to  relatively  large  regions  in  the  image.  Usually# 
however#  the  population  in  a  region  has  a  small  amount  of  varia¬ 
bility#  so  that  the  bins  of  the  histogram  adjacent  to  the  peaks 
often  correspond  to  parts  of  the  same  region.  If  the  adjacent 
values  are  mapped  into  the  peak  value  •  the  histogram  becomes 
more  spike-like.  This  process  is  called  peak  sharpening  and  has 
been  used  for  image  segmentation  C4<  6#  83.  More  specifically#  the 
process  works  as  follows: 

First#  peaks  in  the  histogram#  h#  of  an  image  are  identified. 
Qray  value  i  is  a  peak  if  h<i)  >  h<i+l)  and  h<i>  >  h(i-l). 
Second#  if  h<i)  is  a  peak#  then  h<i-l)  and  h<i+l)  are  mapped  into 
h<i).  This  procedure  can  be  iterated#  or  the  definition  of  a  peak 


can  ba  extended  so  that  h<i)  is  a  psak  if  h<i)  >  h  < i+r  >  and 
h(i)  >  h(i-r>*  for  r*l*  2*  ...  Eventually*  only  a  few  peaks 


(spikes)  will  remain*  and  can  be  used  to  segment  the  image.  If* 

f 

however*  this  mapping  is  applied  to  a  complex  image*  much  of  the 
detail  will  be  lost*  and  features  may  become  distorted.  This  is 
because  the  mapping  is  determined  by  a  global  analysis  of  the  im¬ 
age. 

Suppose*  however*  that  the  histogram  peak  sharpening  process  is 
applied  locally  in  a  neighborhood  of  each  point.  That  is*  a  his¬ 
togram  is  constructed  of  a  neighborhood  about  the  point*  and  is 
sharpened  as  described  above.  The  gray  level  mapping  is  then  ap¬ 
plied*  mapping  the  point  to  the  locally  most  likely  gray  level* 
without  having  to  grow  the  compatible  region  explicitly.  Figure  2 
shows  examples  of  applying  the  method  to  the  images  in  Figure  1. 
While  the  results  are  fairly  good  and  most  of  the  detail  is 
preserved*  the  method  is  expensive  because  a  large  neighborhood 
size  is  needed  in  order  to  construct  a  reliable  histogram. 

2-  2  Smoothing  using  Eirilfell  ntUhbgrhQQti  tilt! 

Methods  such  as  the  one  described  above  require  the  examination 
of  large  neighborhoods  about  each  point*  while  other  smoothing 
operations*  such  as  those  using  the  mean  or  median  of  a  neighbor¬ 
hood*  work  best  using  small  neighborhoods.  It  is  to  be  expected 
that  methods  using  variable  neighborhood  sizes  would  work  better 
than  fixed  neighborhood  methods.  In  particular*  regions  of  an 
image  that  are  reasonably  homogeneous  would  be  smoothed  more  ef¬ 
fectively  using  a  large  neighborhood*  while  busier  regions  might 


require  smeller  neighborhood  sizes. 

Suppose  that  e  quadtree  approx imat ion  to  the  image  is  construct¬ 
ed.  and  the  distribution  of  leaf  sizes  in  the  quadtree  is  used  as 
a  guide  in  determining  the  neighborhood  sizes  to  be  used  in 
smoothing.  The  size  of  a  leaf  in  the  quadtree  corresponds  direct¬ 
ly  to  the  degree  of  homogeneity  of  the  neighborhood  of  the  image 
that  it  represents.  Large  leaves  correspond  to  large  homogeneous 
regions.  and  indicate  that  the  gray  values  in  these  regions  can 
be  smoothed  using  large  neighborhoods.  On  the  other  hand,  edges 
are  represented  by  small  leaves,  and  this  indicates  that  a  small¬ 
er  neighborhood  should  be  used.  The  neighborhood  sizes  that  mere 
used  in  the  examples  of  Figure  3  to  correspond  to  the  various 
leaf  sizes  are  shown  in  Table  1. 

Note  that  if  a  median  filter  is  used  for  smoothing  there  should 
be  little  blurring  even  at  points  corresponding  to  the  borders  of 
leaves  (although  there  may  be  some  blurring  at  the  corners  of 
leaves).  Even  an  averaging  function  should  not  cause  blurring  be¬ 
cause  it  is  unlikely  that  a  whole  region  will  be  represented  by  a 
single  quadtree  leaf.  It  is  more  likely  that  neighboring,  and 
perhaps  smaller,  leaves  will  have  similar  gray  levels  because 
they  represent  parts  of  the  same  region,  perhaps  closer  to  the 
border. 

This  method  is  similar  to  a  "region  growing"  method  that  uses  the 
standard  deviation  or  gradient  magnitude  of  the  gray  values  to 
limit  the  region  sizes.  The  advantage  of  the  current  method  is 
the  computational  efficiency  provided  by  the  quadtree  structure. 


2. 2  Sinag.thina  feu.  rtf  ininq  fefe±  quadtree 


A  naive  smoothing  method  would  bs  to  construct  a  quadtree  from  an 
image<  and  then  replace  each  pixel  by  the  gray  level  of  the  leaf 
to  which  it  corresponds.  This  gives  the  so-called  'q-image' 
(Figure  4a).  The  constant  gray  level  across  each  leaf  gives  a 
blocky  appearance  to  the  image  and  introduces  false  edges. 

A  more  satisfactory  mapping  can  be  found  by  taking  global  statis¬ 
tics  from  the  image  and  a  corresponding  quadtree.  Every  point  in 
the  image  maps  into  some  leaf  in  the  quadtree.  The  frequency  with 
which  gray  level  i  in  the  image  maps  into  gray  level  j  in  the 
quadtree  can  be  used  to  indicate  which  value  is  to  replace  gray 
level  i  in  the  smoothed  image.  The  most  suitable  mapping  for  gray 
level  i  is  that  gray  level  j  to  which  i  most  frequently  maps 
across  the  whole  image  (or  in  some  neighborhood  of  the  point). 
This  mapping  procedure  reduces  the  strong  dependence  on  the  par?- 
ticular  leaf  to  which  a  pixel  corresponds*  and  this  reduces  the 
blockiness  of  the  smoothed  image.  Figure  4b  shows  the  results  of 
applying  this  process  to  the  images  of  Figure  1. 

Note  that  the  process  can  be  repeated  for  several  different  quad¬ 
tree  approximations  of  the  image*  using  different  homogemeity 
criteria.  A  cumulative  frequency  array  can  be  maintained*  and 
this  would  reduce  the  effect  of  the  somewhat  arbitrary  nature  by 
which  the  homogeneity  criteria  are  chosen  for  building  the  quad¬ 
tree.  In  addition*  the  mapping  is  likely  to  be  more  valid  if  it 
is  derived  from  several  quadtree  approximations. 


The  three  methods  discussed  above  all  use  dynamically  variable 
numbers  of  picture  points  to  smooth  an  image.  The  first  method 
selects  points  from  the  neighborhood  by  examining  a  histogram, 
while  the  other  two  methods  rely  on  quadtree  approx imations  of 
the  image.  The  second  method  takes  advantage  of  the  quadtree 
structure  to  locally  alter  the  neighborhood  sizes,  while  the 
third  uses  a  global  frequency  table  to  refine  the  quadtree  ap¬ 
proximation  to  the  image. 

The  first  of  the  methods,  while  perhaps  giving  the  best  results, 
is  computationally  expensive  because  of  the  large  number  of 
points  needed  to  calculate  the  histogram.  This  method  can  be 
compared  with  local  histogram  flattening  techniques  Cl. 23.  whose 
purpose  is  to  increase  contrast  and  separate  out  areas  with 
slightly  different  gray  levels. 

The  second  method  is  more  efficient  because  the  neighborhood 
sizes  are  easily  found,  and  only  simple  operations  such  as  find¬ 
ing  the  median  or  average  of  the  gray  levels  are  required.  The 
results  are  not  significantly  different  from  those  of  the  first 
method,  so  that,  on  the  whole,  it  is  probably  preferable  to  use 
this  method. 

The  third  method  is  simpler  than  the  other  two.  but  it  occasion¬ 
ally  misc lassif ies  points,  especially  when  the  mapping  frequency 
is  calculated  over  the  whole  image  and  then  applied  locally  at 
each  point.  It  would  be  more  expensive  to  compute  local  frequency 


mappings  (sag  on  ragions  whose  sizes  are  proportional  to  the 
quadtree  leaf  sizes)  but  this  would  undoubtedly  lead  to  better 
results. 


1-  Conclusions 

This  paper  has  presented  three  methods  of  smoothing  images  using 
variable  numbers  of  picture  points  to  calculate  the  smoothing 
function.  While  all  three  methods  give  good  results*  the  methods 
using  quadtrees  are  attractive  because  of  the  information  the 
quadtree  provides  about  the  homogeneity  of  the  regions  in  the  im¬ 
age  and  about  the  sizes  of  neighborhoods  that  are  appropriate  at 
different  places  in  the  image. 
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Table  1.  The  neighborhood  sizes  corresponding 
to  various  leaf  sizes. 


Figure  1.  Two  inages 
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Figure  5  (a-d)  Histograms  of  tank  images 
in  Figures  1-4 
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